Custom Report

Author

Joseph H

1 Intoduction

This report is one of 423,206 that I will make, and one of 104,070,413 that could be made.
I “toke” the 1.4 TB Linked-In data that was breached in 2020, and turned it into some insights to power my job HUNT.
The insights I could share in this report, that are also related to my goals, are:
- Industry base recruitment trend.
- Company base workforce timeline.
- Current/part workforce info:
- Basic info: Name, job title, status, social link. I could add geo-location for some that have the data, but it would look creepy.
- Their work period.
- Their experiences.

2 About me

Salutations; I’m Joseph, a self-taught data analyst, engineer, and scraper.
Despite life’s challenges, my goal remains a remote job, either full or part-time, and having friends to tackle the challenges of this changing world with.
To show my skills and dedication, I made this project that yielded this tailored report.

3 About the project

3.1 How this project comes to life?

You would know by now, from my email, that I am hunting for a job.
About a year ago, I scraped contact info from Google Map to get my first job. Later I scraped contact from Linked-In website… you can check how that went in here.

Recently, I finally got to learning SQL because of DuckDB, it is a software that allows you to process big data in your local machine by using storage space as RAM; Then I remembered about a leaked Linked-In data that I couldn’t process.
Thus my journey started to learn SQL, process the data, and make something out of it.

3.2 The process

The process was done in my local machine, and it was as followed.

3.2.1 Downloaded the leaked data

I downloaded the data from a torrent.
There was around 700 .gz file, each is around 280 Mb; 196 GB in total.
Each .gz file contain a 2 GB file; 1.4 TB in total.
Each file have multiple lines, and each one of them is a JSON; Not the file is a JSON, it just have multiple JSONs, one in each line.

3.2.2 Processing the weird data

I this phase I created a script that automatically open an archive, process the file, and save it as a Parquet file with compression level of 22.
I used Python, Pathlib, Polars, and a lot of patience.
The process toke around 20 minutes per file, in total it toke around three weeks (I had to shutdown my PC at night) The result was 700 parquet files, each is around 190 Mb; 133 GB in total.

3.2.3 Making relational database

The data in the datasets were nested, especially the “experience” field, it had the experience of a person and the company info; The problem is that the company info get repeated multiple tiles, across all datasets.
Making a relational database will solve this, and make the exploratory data analysis easier.
The code was split in two:
1. I used Polars to split each of the 700 datasets into mini relational databases.
2. I used DuckDB to merge all the mini relational databases and remove duplicates in some, mainly company and university information’s.

The result was a relational database that is 73 GB in size; From 1.4 TB to 73 GB.

All of this is using my PC, so servers were harmed, only my CPU fan and my ear.

3.2.4 Filter

I filtered out companies base on their industry, country, and whether I have the email of one of the higher ups.

4 General graphs

4.1 chemicals indestry’s workforce status over the years.

4.2 givaudan’s workforce status over the years.

5 Workforce sample

5.1 Alaa Tqm

Job title: Producton specialist
Associated: True
Socials: https://linkedin.com/in/alaa-el-garhy-tqm-88782342

5.1.1 Alaa Tqm’s working period at givaudan

5.1.2 Gantt plot of Alaa Tqm’s experience

5.2 Andrea Herrera

Job title: Beverages applicactions
Associated: True
Socials: https://linkedin.com/in/andrea-carolina-granados-herrera-01a44934

5.2.1 Andrea Herrera’s working period at givaudan

5.2.2 Gantt plot of Andrea Herrera’s experience

5.3 Andreas Haun

Job title: Leiter technische dienste ke
Associated: True
Socials: https://linkedin.com/in/andreas-haun-100a5614a

5.3.1 Andreas Haun’s working period at givaudan

5.3.2 Gantt plot of Andreas Haun’s experience

5.4 Axel Morvan

Job title: Technicien de labo
Associated: True
Socials: https://linkedin.com/in/axel-morvan-00497412

5.4.1 Axel Morvan’s working period at givaudan

5.4.2 Gantt plot of Axel Morvan’s experience

5.5 Balta Drago

Job title: Lagerlogistik operator
Associated: False
Socials: https://linkedin.com/in/balta-drago-52755692

5.5.1 Balta Drago’s working period at givaudan

5.5.2 Gantt plot of Balta Drago’s experience

5.6 Bilge Çifter

Job title: Sales assistant
Associated: True
Socials: https://linkedin.com/in/bilgekaya

5.6.1 Bilge Çifter’s working period at givaudan

5.6.2 Gantt plot of Bilge Çifter’s experience

5.7 Danvers Francine

Job title: Assistante parfumerie
Associated: True
Socials: https://linkedin.com/in/danvers-francine-a610a9182

5.7.1 Danvers Francine’s working period at givaudan

5.7.2 Gantt plot of Danvers Francine’s experience

5.8 Elle Liu

Job title: Customs coordinator
Associated: True
Socials: https://linkedin.com/in/elle-liu-439844126

5.8.1 Elle Liu’s working period at givaudan

5.8.2 Gantt plot of Elle Liu’s experience

5.9 Fabiano Poletto

Job title: Logistics assistant and junior buyer
Associated: False
Socials: https://linkedin.com/in/fabiano-donizete-poletto-37539a10 | https://linkedin.com/in/fabiano-poletto-37539a10

5.9.1 Fabiano Poletto’s working period at givaudan

5.9.2 Gantt plot of Fabiano Poletto’s experience

5.10 Flavia Pinheiro

Job title: Marketing category manager
Associated: False
Socials: https://linkedin.com/in/flavia-pinheiro-41925b4

5.10.1 Flavia Pinheiro’s working period at givaudan

5.10.2 Gantt plot of Flavia Pinheiro’s experience

5.11 Florian Etienne

Job title: It support specialist
Associated: False
Socials: https://linkedin.com/in/florian-etienne-829878aa

5.11.1 Florian Etienne’s working period at givaudan

5.11.2 Gantt plot of Florian Etienne’s experience

5.12 Gieri Caveng

Job title: Directeur du personnel
Associated: False
Socials: https://linkedin.com/in/gieri-caveng-62b44a10 | https://linkedin.com/in/giericaveng

5.12.1 Gieri Caveng’s working period at givaudan

5.12.2 Gantt plot of Gieri Caveng’s experience

5.13 Hanspeter Baenziger

Job title: Hauswart
Associated: True
Socials: https://linkedin.com/in/hanspeter-baenziger-950b7b136

5.13.1 Hanspeter Baenziger’s working period at givaudan

5.13.2 Gantt plot of Hanspeter Baenziger’s experience

5.14 Hasmukh Patel

Job title: Retired
Associated: False
Socials: https://linkedin.com/in/hasmukh-patel-205a20b7

5.14.1 Hasmukh Patel’s working period at givaudan

5.14.2 Gantt plot of Hasmukh Patel’s experience

5.15 Hussein Kabil

Job title: ****
Associated: True
Socials: https://linkedin.com/in/hussein-kabil-4a1776160

5.15.1 Hussein Kabil’s working period at givaudan

5.15.2 Gantt plot of Hussein Kabil’s experience

5.16 Hwang Kwon

Job title: Food technologist
Associated: False
Socials: https://linkedin.com/in/hwang-ki-kwon-b58a83127

5.16.1 Hwang Kwon’s working period at givaudan

5.16.2 Gantt plot of Hwang Kwon’s experience

5.17 Ismène Aderaze

Job title: Technicienne
Associated: True
Socials: https://linkedin.com/in/ismène-aderaze-4700b9176

5.17.1 Ismène Aderaze’s working period at givaudan

5.17.2 Gantt plot of Ismène Aderaze’s experience

5.18 Jan Wijngaard

Job title: Voorman
Associated: False
Socials: https://linkedin.com/in/jan-wijngaard-939b78150

5.18.1 Jan Wijngaard’s working period at givaudan

5.18.2 Gantt plot of Jan Wijngaard’s experience

5.19 Jhenifer Teixeira

Job title: Estagiã rio
Associated: True
Socials: https://linkedin.com/in/jhenifer-teixeira-94555a129 | https://facebook.com/jhenifer.teixeira.10

5.19.1 Jhenifer Teixeira’s working period at givaudan

5.19.2 Gantt plot of Jhenifer Teixeira’s experience

5.20 Jolanda De

Job title: ****
Associated: True
Socials: https://linkedin.com/in/jolanda-brouwer-de-vos-jb1960

5.20.1 Jolanda De’s working period at givaudan

5.20.2 Gantt plot of Jolanda De’s experience

5.21 Juliana Moraes

Job title: Gerenciamento de projetos
Associated: True
Socials: https://linkedin.com/in/juliana-moraes-30991b15

5.21.1 Juliana Moraes’s working period at givaudan

5.21.2 Gantt plot of Juliana Moraes’s experience

5.22 Katelyn Daniel

Job title: Sensory panelist
Associated: True
Socials: https://linkedin.com/in/katelyn-daniel-b07404142

5.22.1 Katelyn Daniel’s working period at givaudan

5.22.2 Gantt plot of Katelyn Daniel’s experience

5.23 Kathleen Cameron

Job title: Vice president creative fragrance development
Associated: True
Socials: https://linkedin.com/in/kathleen-cameron-4727a925

5.23.1 Kathleen Cameron’s working period at givaudan

5.23.2 Gantt plot of Kathleen Cameron’s experience

5.24 Leandro Petit

Job title: Perfumista fine fragrances
Associated: True
Socials: https://facebook.com/leandro.m.petit | https://linkedin.com/in/leandro-marinho-petit-b3923620 | https://linkedin.com/in/leandro-petit-b3923620

5.24.1 Leandro Petit’s working period at givaudan

5.24.2 Gantt plot of Leandro Petit’s experience

5.25 Liliana Estrada

Job title: Cfm
Associated: True
Socials: https://linkedin.com/in/liliana-estrada-40409a116

5.25.1 Liliana Estrada’s working period at givaudan

5.25.2 Gantt plot of Liliana Estrada’s experience

5.26 Lily Tang

Job title: Material management manager
Associated: True
Socials: https://linkedin.com/in/lily-tang-a9b35812

5.26.1 Lily Tang’s working period at givaudan

5.26.2 Gantt plot of Lily Tang’s experience

5.27 Maeva Leclercq

Job title: Assistante parfumeur
Associated: True
Socials: https://linkedin.com/in/maeva-leclercq-4664a2158

5.27.1 Maeva Leclercq’s working period at givaudan

5.27.2 Gantt plot of Maeva Leclercq’s experience

5.28 Marco Edling

Job title: Compounder
Associated: True
Socials: https://linkedin.com/in/marco-edling-84073a135

5.28.1 Marco Edling’s working period at givaudan

5.28.2 Gantt plot of Marco Edling’s experience

5.29 Marcos Linares

Job title: Operateur en logistique
Associated: True
Socials: https://linkedin.com/in/marcos-linares-188077131

5.29.1 Marcos Linares’s working period at givaudan

5.29.2 Gantt plot of Marcos Linares’s experience

5.30 Maria Tavares

Job title: Head of global innovation strategy - corporate finance and business development
Associated: False
Socials: https://linkedin.com/in/dr-maria-tavares-1a690722 | https://linkedin.com/in/maria-bettencourt-tavares-1a690722 | https://linkedin.com/in/maria-tavares-1a690722

5.30.1 Maria Tavares’s working period at givaudan

5.30.2 Gantt plot of Maria Tavares’s experience

5.31 Matias Alfonzo

Job title: Operario de deposito
Associated: True
Socials: https://linkedin.com/in/matias-alfonzo-152961142

5.31.1 Matias Alfonzo’s working period at givaudan

5.31.2 Gantt plot of Matias Alfonzo’s experience

5.32 Mike Chen

Job title: Manager
Associated: True
Socials: https://linkedin.com/in/mike-chen-5b4a7919

5.32.1 Mike Chen’s working period at givaudan

5.32.2 Gantt plot of Mike Chen’s experience

5.33 Patrick Van Geffen

Job title: Operator
Associated: True
Socials: https://linkedin.com/in/patrick-van-geffen-114b77189

5.33.1 Patrick Van Geffen’s working period at givaudan

5.33.2 Gantt plot of Patrick Van Geffen’s experience

5.34 Rocio Ortiz

Job title: ****
Associated: True
Socials: https://linkedin.com/in/rocioortiz2020

5.34.1 Rocio Ortiz’s working period at givaudan

5.34.2 Gantt plot of Rocio Ortiz’s experience

5.35 Seref Celik

Job title: Chemikant
Associated: False
Socials: https://linkedin.com/in/seref-celik-713b1653

5.35.1 Seref Celik’s working period at givaudan

5.35.2 Gantt plot of Seref Celik’s experience

5.36 Talita Nunes

Job title: Analista de logã stica
Associated: True
Socials: https://linkedin.com/in/talita-nunes-b053241b3

5.36.1 Talita Nunes’s working period at givaudan

5.36.2 Gantt plot of Talita Nunes’s experience

5.37 Terrence Tao

Job title: Sampling leader
Associated: True
Socials: https://linkedin.com/in/terrence-tao-667961126

5.37.1 Terrence Tao’s working period at givaudan

5.37.2 Gantt plot of Terrence Tao’s experience

5.38 Theo Rindlisbacher

Job title: Disponent
Associated: True
Socials: https://linkedin.com/in/theo-rindlisbacher-14860b146

5.38.1 Theo Rindlisbacher’s working period at givaudan

5.38.2 Gantt plot of Theo Rindlisbacher’s experience

5.39 Thiago Donadoni

Job title: Ehs supervisor
Associated: True
Socials: https://linkedin.com/in/thiago-amã©rico-donadoni-02262a32 | https://linkedin.com/in/thiago-américo-donadoni-02262a32 | https://linkedin.com/in/thiago-donadoni-02262a32

5.39.1 Thiago Donadoni’s working period at givaudan

5.39.2 Gantt plot of Thiago Donadoni’s experience

5.40 Timea Tuba

Job title: Sen technogist beverages cee
Associated: True
Socials: https://linkedin.com/in/timea-tuba-3b0bb0137